How can humans understand their automated cars? HMI principles, problems and solutions

As long as vehicles do not provide full automation, the design and function of the Human Machine Interface (HMI) is crucial for ensuring that the human “driver” and the vehicle-based automated systems collaborate in a safe manner. When the driver is decoupled from active control, the design of the HMI becomes even more critical. Without mutual understanding, the two agents (human and vehicle) will fail to accurately comprehend each other’s intentions and actions. This paper proposes a set of design principles for in-vehicle HMI and reviews some current HMI designs in the light of those principles. We argue that in many respects, the current designs fall short of best practice and have the potential to confuse the driver. This can lead to a mismatch between the operation of the automation in the light of the current external situation and the driver’s awareness of how well the automation is currently handling that situation. A model to illustrate how the various principles are interrelated is proposed. Finally, recommendations are made on how, building on each principle, HMI design solutions can be adopted to address these challenges

Communicating product user reviews and ratings in interfaces for e-commerce: a multimodal approach

This paper describes a comparative empirical evaluation study that uses multimodal presentations to communicate review messages in an e-commerce platform. Previous studies demonstrate the effective use of multimodality in different problem domains (e.g. e-learning). In this paper, multimodality and expressive avatars are used to communicate information related to product reviews messages. The data of the reviews was opportunistically collected from Facebook and Twitter. Two independent groups of users were used to evaluate two different presentations of reviews and ratings using as a basis an experimental e- commerce platform. The control group used a text-based with emojis presentation and the experimental group used a multimodal approach based on expressive avatars. Three parameters of usability were measured. These were efficiency, effectiveness, user satisfaction, and user preference. The result showed that the two approaches performed similarly. These findings provide a basis for further experiments in which text, emojis and expressive avatars can be combine to communicate a larger volume of reviews and ratings

OESDs in an on-road study of semi-automated vehicle to human driver handovers

Design of appropriate interaction and human–machine interfaces for the handover of control between vehicle automation and human driver is critical to the success of automated vehicles. Problems in this interfacing between the vehicle and driver have led, in some cases, to collisions and fatalities. In this project, Operator Event Sequence Diagrams (OESDs) were used to design the handover activities to and from vehicle automation. Previous work undertaken in driving simulators has shown that the OESDs can be used to anticipate the likely activities of drivers during the handover of vehicle control. Three such studies showed that there was a strong correlation between the activities drivers represented in OESDs and those observed from videos of drivers in the handover process, in driving simulators. For the current study, OESDs were constructed during the design of the interaction and interfaces for the handover of control to and from vehicle automation. Videos of drivers during the handover were taken on motorways in the UK and compared with the predictions from the OESDs. As before, there were strong correlations between those activities anticipated in the OESDs and those observed during the handover of vehicle control from automation to the human driver. This means that OESDs can be used with some confidence as part of the vehicle automation design process, although validity generalisation remains an important goal for future research

How a Robot's Social Credibility Affects Safety Performance

© Springer Nature Switzerland AG 2019. This is a post-peer-review, pre-copyedit version of a conference paper published in: Social Robotics: 11th International Conference, ICSR 2019, Madrid, Spain, November 26–29, 2019. The final authenticated version is available online at: http://dx.doi.org/10.1007/978-3-030-35888-4_69.This paper connects the two domains of Human-Robot Interaction (HRI) and safety engineering to ensure that the design of interactive robots considers the effect of social behaviours on safety functionality. We conducted a preliminary user study with a social robot that alerts participants during a puzzle-solving task to a safety hazard. Our study findings show an indicative trend where users who were interrupted by a socially credible robot were more likely to act to mitigate the hazard than users interrupted by a robot lacking social credibility